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(1) TITLE 

NAVIGATING ORGANIZATIONAL STRUCTURES 

(2) CROSS-REFERENCE TO RELATED APPLICATIONS 

Not Applicable. 

(3) STATEMENT REGARDING FEDERALLY SPONSORED RESEARCH OR 
DEVELOPMENT 

Not Applicable. 

(4) REFERENCE TO AN APPENDIX 

Not Applicable. 

(5) BACKGROUND 

(5.1) FIELD OF TECHNOLOGY 

[0001] The present invention relates generally to topical decision algorithms 
and structures. 

(5.2) DESCRIPTION OF RELATED ART 

[0002] In the past, many different systems of organization have been 

developed for categorizing different types of items. Such systems can be used for 
organizing almost anything, from material items (e.g., different types of screws to 
be organized into storage bins, books to be stored in an intuitive arrangement in a 
library, viz. the Dewey Decimal System, and the like) to the more recent need 
inspired by the computer and Internet revolution for organized categorization of 
knowledge items (e.g., informational documents, book content, visual images, and 
the like). Many known forms of electronic organizational structures, such as 
graphs, structures generally referred to in the art as hierarchical structures, or more 
simply hierarchies, and the like, have been developed. The larger the hierarchy, 



10013642-1 

the more complicated become the options which users can select from. As 
selection options grow, the harder it gets for users to make the next choice for 
working through the hierarchy structure to reach a desired target. 
[0003] A simple example of an Internet hierarchy structure which allows 

5 searching by the user is a website homepage (e.g., www.hp.com, 

www.yahoo.com, or the like) where links are provided whereby the user may step 
through the website. Another example of a large hierarchy would be a customer 
support site where cases have to be assigned by domain experts to a location in a 

q hierarchy of products, or where a call qualifier has to decide to whom to dispatch it. 

ipsa 

m Another application is where an electronic mail (hereinafter "e-mail") message is 
O received and e-mail qualifier has to decide where to forward it. As another more 

m 

specific example, on the Internet there is a site for the Universal Description, 

H: Discovery and Integration of Business for the Web (www.uddi.org). The UDDI 

pj 

m project goal is to create a registry for any type and size of business wherein the 
registry is a platform-independent, open framework for describing services, 
discovering businesses, and integrating business services. The organizational 
structure includes a plurality of hierarchies, intended to enable users to quickly and 
dynamically find registered businesses in any field. Both in registering a new 
business and in finding a registered business suitable for specific commerce goals, 

20 the users wind their way (generally "point-and-click" or enter specific keyword 
searches) through the UDDI hierarchical maze (note, implementations of the 
present invention can be applied to any large hierarchy, e.g., tree structures, Web 
address cross-links, and the like, depending on the specific implementation). 



-3- 



10013642-1 

[0004] Methods and technology, known as classifiers, exist for automatically 
assigning items to categories in a hierarchy. Many known automated forms of 
hierarchical organization classifiers have been developed, e.g., rule-based 
assignment, multi-category flat categorization (such as using Naive Bayes or C4.5 
algorithms), level-by-level hill-climbing categorization (also known as "Pachinko 
machine" categorization), and level-by-level probabilistic categorization. Some of 
these are forms of machine learning in that the methods can improve in accuracy 
using examples of items for which the correct category is known. Classification 
technology such as this is being used to create and maintain computer-based 
hierarchies in that it can be used to automatically identify the category that, based 
on the description of the item, forms the most appropriate location for it. Such 
classifier products and services for automating organization of unstructured 
information in digital domains are available commercially, for example from 
Autonomy Inc., having a place of business in San Francisco, CA. A user may 
need to navigate a hierarchy not to place an item in it, but rather to see what other 
items are in a category. When searching a large hierarchy, the user may have a 
description of the type of information contained in the category they are looking for, 
without knowing where this category is in the hierarchy or even whether there are 
multiple categories that match their information needs. The name or description of 
a branch in a hierarchy is usually terse and may not be highly indicative of the 
items contained in such a branch, especially not of the sub-branches contained 
underneath it. In that case, the user needs assistance as to which path is likely to 
lead to a category that matches their information needs. 
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[0005] Two problems of searching a large hierarchy are: (1) which path is 
the next best path toward a desired target, and (2) what is the next best refinement 
of the search query based on the current hierarchy node selection. Prediction 
technology (e.g., machine-learning (a branch of artificial intelligence technology), 
5 classification/categorization, and the like) is being used to create and maintain 
computer-based hierarchies. "Classifier" products and services for automating 
operation of unstructured information in digital domains, i.e., for automating 
hierarchy structures, are available commercially, such as from Autonomy, Inc. 
p company, having a place of business in San Francisco, CA. Machine-learning in 
iqjj the nature of a classifier program allows for automated recognition of common data 

£3 patterns and content - - usually based on known data pattern or content training 

ftj 

*Q cases, e.g., where it is known that such-and-such a labeled data pattern (e.g., 
g words of an informational document, medical symptoms of known diseases, and 
pj the like) is probabilistically indicative of such-and-such a topic - - in order to classify 
i5pj each new data set added thereafter into the hierarchy (or other organizational 

structure). Thus fundamentally, via training, the classifier becomes an automated 
decision maker as to where in the structure new input is to be placed. However, as 
the number of choices - - particularly among the currently available choices of the 
hierarchy structure - - grows, prediction technologies degrade in their ability to 
20 make good proposals for the next likely choice. 

[0006] Unassisted hierarchical navigation of choices leaves the user 
primarily with persistence and luck, using their own inductive reasoning to step 
through the structure. Unless the usual terse labels for branches of the structure 
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are perceived well, the user can easily get lost and frustrated. Multiple steps, 
accompanied by several false path searches, generally may be required to drill- 
down through large hierarchies. 

[0007] Some website hierarchies are based on popularity of topics and 
subtopics rather than by a calculated, directed personalization of the user's goal or 
specific information provided by the user. Again, searches are generally difficult 
due to many optional paths that are provided. 

[0008] Some software solutions (e.g., WordPerfect 1 " 1 , WORD 2000 tm ) provide 
a short list for previously used menu items; once a particular item has been used, it 
is brought more or less to the foreground. This however is not a true classification 
of available information in a directory structure and does not dynamically adjust 
itself as more information becomes available during a particular search down a 
menu tree. 

[0009] There is a need for an advanced methodology and tool which helps 
the user in making choices while navigating through a large hierarchy, e.g., 
whether to place a new item into it or to find the relevant category or categories 
where desired items may be found. Moreover, a proper solution should also 
benefit those working in creating, maintaining, and running a computerized 
hierarchy-dependent site using a classifier by directing attention to fewer and more 
accurate selection options. A proper solution should be interactive between the 
user and automated classifier(s) employed, dynamically guiding the user towards 
the selection of the targeted category and desired results (target goal). 
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(6) BRIEF SUMMARY 

[0010] In its basic aspect, embodiments of the present invention relate 
generally to topical decision algorithms. Some implementations relate more 
particularly to organizational structures such as hierarchical arrangement systems, 
5 and some specifically to a methodology and tool for assisting users in selection 

from large hierarchies via classification, particularly in computerized large hierarchy 
applications. In prediction and machine-learning technology, using given 
O information from a user and a set of choices (e.g., a hierarchy structure) and, 
W using a classifier program, computing what is the next best choice for navigating 
JjJ the set of choices, or, more generally, the degree to which any choice at a current 
^ level is supported by the available information, i.e., a probability of success 
p associated with each currently available choice. An interactive interface is 

SSSS S 

RJ provided between the user and the set owner that dynamically feeds back the 

o 

Rl results of classification to the user preferably at each navigation step, i.e., 
is specifying probabilities, suggesting choices, or highlighting the best choice(s) or 
the path(s) most likely leading to the best ultimate choice of the set. 
[001 1] The foregoing summary is not intended to be an inclusive list of all 
the aspects, objects, advantages and features of the embodiments of the present 
invention nor should any limitation on the scope of the invention be implied 
20 therefrom. This Summary is provided in accordance with the mandate of 37 C.F.R. 
1.73 and M.P.E.P. 608.01(d) merely to apprise the public, and more especially 
those interested in the particular art to which the invention relates, of the nature of 
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the invention in order to be of assistance in aiding ready understanding of the 
patent in future searches. Objects, features and advantages of the embodiments 
of the present invention will become apparent upon consideration of the following 
explanation and the accompanying drawings, in which like reference designations 
5 represent like features throughout the drawings. 



(7) BRIEF DESCRIPTION OF THE DRAWING 



O [0012] FIGURE 1 is a flowchart of a large hierarchy search process in 
IM accordance with embodiments of the present invention. 

f (8) DETAILED DESCRIPTION 

O 

hi 

fif [001 3] Reference is made now in detail to embodiments of the present 

o 

fU invention which illustrate the best mode presently contemplated for practicing the 
invention. Alternative embodiments are also briefly described as applicable. 
[0014] Prediction technology may be used to bring the most likely choices to 
the fore for easy selection (e.g., via on-screen highlighting, probability of 

15 correctness, defaults, and the like). The embodiments of the present invention are 
implementable as a computer program. The embodiments of the present invention 
relate to an interactive classifier methodology and tool, using feedback from the 
classifier to the user - - namely, a user interface expressing the results of the 
classifier to make "better" choices more prominent. Moreover, automated updating 
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of the classification as the user starts to go down a particular hierarchy path is 
implemented. 

[001 5] Basically, a classifier is employed at each decision node of the large 
hierarchy structure to recommend the best probable options for the next step to be 
taken for the user; one or more of the known manner classifier processes 
described in the Background section hereinabove may be adapted for use in 
accordance with certain process steps and associated programming of the 
embodiments of the present invention as described hereinbelow. 
[0016] FIGURE 1 is a flowchart of a large hierarchy search process in 

accordance with an implementation of the present invention. A UDDI hierarchy 
example will be employed for the purpose of explanation of this implementation; no 
limitation on the scope of the invention is intended nor should any be implied 
therefrom. 

[0017] Assume a corporate information technology manager ("ITM") for 
"ABC Inc." has been authorized to register the corporations business at the UDDI 
website in an among at least one of the hierarchies available there. Thus, there is 
a collection of choices, organized in some form of large hierarchical structures, 
each having specific nodes therein. The ITM provides whatever information data is 
applicable to the business (e.g., name, type of business, address, 
telecommunication contact information, and the like), referred to hereinafter as 
"given information." This starter set of data can be any form of personalization 
data and include any available information. In the exemplary implementation for 
case classification it includes the particular case to be assigned somewhere in a 
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hierarchy. However, it can simply be based on the user's identity, previous usage 
patterns, or aggregate analysis of the user and other users. 
[0018] A known manner classifier (or the like proprietary mechanism for 
comparing; see Background) is employed to examine the given information with 
respect to the collection of choices available at this top level and to determine the 
best predicted options for the next best options available, step 1 01 . More 
specifically, the ITM wants to know the options for placing ABC into the hierarchy, 
but also of all the options available, which are the best choices to reach a node 
where other similar businesses are to be found, i.e., most likely particular path(s) 
(note that multiple hierarchy location listings for each business may be possible 
and desirable) that future users searching for such a business will follow (e.g., to 
the ITM, the target is to determine what is the most likely correct answer to the 
information related to the user's navigation goal, associated with reaching the 
"right" goal node, or what is the probability associated with each potential choice 
that it is a good place to place ABC, or the like probabilistically correct location in 
the structure for ABC). Note that other types of classifiers may be employed 
depending on the organization structure(s) being analyzed in any specific 
implementation. 

[0019] The top level classifier presents, step 103, then interactively provides 
back to the ITM labeled choices, namely identifying the next level nodes of the 
UDDI hierarchy structure (e.g., in a hierarchy tree-form structure symbology, also 
known as "branches") that are available to continue towards an appropriate 
node(s) where ABC's link should be stored. Most importantly, the choices are 
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"highlighted" in some fashion which will indicate to the ITM which paths have the 
highest probabilities of reaching the appropriate final node(s). The "highlighting" 
can take the form of stated probabilities - - e.g., "path A 95%, path B 82%, etc.", 
simple color coding (preferred in color video monitor implementations) or the like - - 
along with a label that is sufficient to identify each path (e.g., "path A = retail sales," 
"path B = discount retail sales," "path C = wholesalers," etc.). Optionally, if sub- 
choice^) can be predicted with good confidence from the given information (e.g., 
"retail sales -» alcoholic beverages -» wine"), it can be listed as a shortcut choice, 
possibly allowing the ITM to accelerate the process. The processor then waits, 
step 105, for the ITM's reply, step 105. 

[0020] Next, step 105, following receipt of the ITM's reply, a determination, 
step 107, is made as to whether the choice reflects a hierarchy terminus node 
(e.g., in a tree structure, a "leaf node). In the alternative, the YES-path can also 
reflect the situation where the choice is an internal node in the hierarchy but is still 
a good place to place ABC and that no further refinement is needed. 
[0021] If so (107, YES-path), the ITM is notified and ABC's link is stored at 
that UDDI hierarchy node (e.g., "wine and cheese specialty shops in Palo Alto 
CA"), step 109. Note that as part of this "final" choice step, the program can 
update its own algorithms (shown in phantom step 108,"LEARN") having used the 
current session as a new "training example" for its data set. Note that this machine 
learning can occur at any or all input/output points of the process. In other words, 
the algorithm learns from each selection, making it a better, more precise predictor 
for the future. One means of accomplishing this is by redistributing the "eliminated" 
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probability mass over the remaining branches. An alternative is to have a 
separately trained classifier for each sub-node in the hierarchy. The user interface 
is updated to reflect the newly available, more accurate, classification data. For 
example, if probabilities are shown, then after the user starts drilling down a 
particular path, the probability for that path goes to 100% and probabilities are 
shown for the next level down. 

[0022] The process then queries whether the ITM wants to place ABC at 
other nodes of the hierarchy, step 111. If not (1 1 1 , NO-path), the session is 
terminated, step 113. If so (1 1 1 , YES-path), the session returns to the highest 
level, original search collection of choices, step 115, whereby the ITM can start 
over and at some point choosing a different branch. 

[0023] If the ITM input does not reflect a hierarchy terminus node selection 
(107, NO-path), the ITM's input reflects a refinement choice. Therefore, having the 
given information and the new refinement choice input, the process can narrow the 
set of newly available options in view of the known hierarchy substructure 
subjacent the recently chosen branch path, viz., next branches and nodes, step 
1 17. The classifier then repeats the analysis phase, looping to step 101 . The 
process continues until a terminus node is achieved, 109. 

[0024] Thus, "starter information," that is, given both information from a user 
and a set of choices (ideally but not necessarily organized into a hierarchy such as 
a menu tree) and, using a classifier program, a recommendation is made as to 
what is the next best choice for navigating the set of choices, or, more generally, 
the degree to which any choice at a current level is supported by the available 
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information, i.e., a probability of success associated with each currently available 
choice. An interactive interface is provided between the user and the set owner 
(e.g., an Internet web directory) that dynamically feeds back the results of 
classification to the user at each navigation step, i.e., specifying probabilities, 
suggesting choices, or highlighting the best choice(s) or the path(s) most likely 
leading to the best ultimate choice). 

[0025] In one alternative embodiment, the user's selection of a particular 
branch can be interpreted by the classifier as a possibly a poor choice. That is, the 
classifier treats the selection of a branch as a possibly incorrect input. If there is 
overwhelming evidence that the proper category is elsewhere in the hierarchy, the 
classifier continues to highlight alternative branches not selected. This is helpful in 
poorly organized or ambiguous hierarchies where the top-level branches are not 
very indicative of the specific subcategories. A "smart look-ahead," or "foresight," 
feature can be implemented wherein based on the current "starter information," 
likely choices are identified that are actually lower than currently available, next 
lower level, nodes of the structure. These identified foresight nodes can be 
presented for immediate consideration to the user in a known manner user 
interface format rather than waiting until the user drills down through the hierarchy 
to those nodes. 

[0026] The foregoing description of embodiments of the present invention 
have been presented for purposes of illustration and description. It is not intended 
to be exhaustive or to limit the invention to the precise form or to exemplary 
embodiments disclosed. Obviously, many modifications and variations will be 
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apparent to practitioners skilled in this art. Similarly, any process steps described 
might be interchangeable with other steps in order to achieve the same result. 
These embodiments were chosen and described in order to best explain the 
principles of the invention and its best mode practical application, thereby to 
enable others skilled in the art to understand the invention for various 
embodiments and with various modifications as are suited to the particular use or 
implementation contemplated. It is intended that the scope of the invention be 
defined by the claims appended hereto and their equivalents. Reference to an 
element in the singular is not intended to mean "one and only one" unless explicitly 
so stated, but rather means "one or more." Moreover, no element, component, nor 
method step in the present disclosure is intended to be dedicated to the public 
regardless of whether the element, component, or method step is explicitly recited 
in the following claims. No claim element herein is to be construed under the 
provisions of 35 U.S.C. Sec. 112, sixth paragraph, unless the element is expressly 
recited using the phrase "means for. . ." and no process step herein is to be 
construed under those provisions unless the step or steps are expressly recited 
using the phrase "comprising the step(s) of. . .." 
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